Developing and Researching PhET simulations for Teaching Quantum Mechanics 
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Quantum mechanics is difficult to learn because it is counterintuitive, hard to visualize, mathe- 
matically challenging, and abstract. The Physics Education Technology (PhET) Project, known for 
its interactive computer simulations for teaching and learning physics, now includes 18 simulations 
on quantum mechanics designed to improve learning of this difficult subject. Our simulations include 
several key features to help students build mental models and intuitions about quantum mechanics: 
visual representations of abstract concepts and microscopic processes that cannot be directly ob- 
served, interactive environments that directly couple students' actions to animations, connections 
to everyday life, and efflcient calculations so students can focus on the concepts rather than the 
math. Like all PhET simulations, these are developed using the results of education research and 
feedback from educators, and are tested in student interviews and classroom studies. This article 
provides an overview of the PhET quantum simulations and their development. We also describe 
research demonstrating their effectiveness and share some insights about student thinking that we 
have gained from our research on quantum simulations. 

PACS numbers: 01.40.Fk,01.40.G-,01.40.gb,01.50.ht 



I. INTRODUCTION 

Quantum mechanics has challenged many of the great- 
est minds in physics, so it is no surprise that it is a diffi- 
cult subject for students to learn. In addition to the stan- 
dard rigors associated with any topic in physics, quan- 
tum mechanics presents many of its own unique chal- 
lenges that conspire to make it extraordinarily difficult 
and frustrating for most students to build mental models. 
It is counterintuitive and surprising to find that the mi- 
croscopic world does not behave at all the way we would 
expect, as the intuitions we have built up from interact- 
ing with our daily environment do not hold up. Because 
most of the phenomena we study in quantum mechanics 
cannot be observed directly, it is often difficult to con- 
struct mental models by which to visualize such elusive 
phenomena. It is also mathematically challenging, in- 
volving lengthy calculations to analyze the simplest phe- 
nomena, with most real-world phenomena falling outside 
the realm of our ability to calculate. Finally, at least in 
the form it is often taught, quantum mechanics is discon- 
nected from everyday life, focusing on simplified abstract 
models at worst, and phenomena with which we have no 
direct experience at best. 

Extensive research in quantum mechanics education 
shows that students often do not learn what instruc- 
tors would like them to learn in high school mod- 
ern physics coursesi*^'^'^'^, sophomore level modern 
physics courses^iSiiSiiiS'ii, junior level quantum mcchan- 
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and even graduate coursei 
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ICS courses 

Research on the development of transformed modern 
physics course3i2ii2iii^, as well as on tutorials targeting 
specific student difficultie a^°i^^'^^i^^ , suggests that im- 
proved student learning is possible. However, most re- 
search that has been done so far has focused on only a 



few key topics such as atomic models, the photoelectric 
effect, and the properties of wave functions. This is only 
the tip of the iceberg, and much remains to be discov- 
ered regarding student learning of other topics, including 
non-traditional topics such as real-world applications and 
interpretations of quantum mechanics, as well as student 
beliefs about quantum mechanics and the nature of sci- 
ence, and how to best improve student understanding 
of all aspects of quantum mechanics. There is a need for 
further research and development of techniques and tools 
for effectively teaching quantum mechanics. 

Educational computer simulations are promising tools 
that have been shown to be effective in helping students 
learn many topics in introductory physics^ii^i^^. Be- 
cause of the added problems of visualizing and building 
an intuition for the abstract principles of quantum me- 
chanics, the power of simulations to provide interaction, 
visualization, and context has the potential to be even 
more helpful in this subject than in introductory physics. 

Many teachers and researchers have developed com- 
puter simulations to assist students in learning quantum 
mechanics j^'''^^i^^'^°i'^^'^^i'^^''^^ While many of these simu- 
lations may be useful for providing visual models of quan- 
tum phenomena, research on their user interface and ef- 
fectiveness for learning has been limited. Many of the 
user interfaces or representations of physics are not con- 
sistent with research on user-interface design^*' and how 
students learn"^^, potentially limiting their effectiveness. 

The Physics Education Technology (PhET) Project 
creates research-based interactive computer sim- 
ulations for teaching and learning physics and 
makes them freely available from the PhET web- 
site (http:/ /phet. colorado.edu). The simulations are 
animated, interactive, and game-like environments 
where students learn through exploration. We empha- 
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size the connections between real-life phenomena and 
the underlying science, and seek to make the visual 
and conceptual models of expert physicists accessible to 
students. We have attempted to address the problem of 
student learning of quantum mechanics by developing 
PhET simulations in this subject using our research- 
based design principle a^^i^^ , and conducting research on 
their effectiveness in various contexts. 

In this paper we present an overview of the PhET 
quantum simulations (Section II), how they are devel- 
oped (Section III), examples of classroom use and studies 
of their effectiveness (Section IV), and insights into stu- 
dent thinking we have gained from conducting student 
interviews on these simulations (Section V). 



II. QUANTUM MECHANICS SIMULATIONS 



A. Visualization 
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We have two main goals for PhET simulations: in- 
creased student engagement and improved learning. Sim- 
ulations are specifically designed to support students in 
constructing a robust conceptual understanding of the 
physics through exploration. Their design is grounded 
in research. We draw from existing research literature 
on how students learn, conceptual difficulties in physics, 
and educational technology design. We also make exten- 
sive use of student interviews and classroom testing to 
explore usability, interpretation, and learning issues, and 
to develop general simulation design principles. 

PhET is best known for our simulations on topics in 
introductory physics, such as Circuit Construction Kit, 
Masses and Springs, and The Moving Man.^^'^'^'^^ How- 
ever, the features that make these simulations effective 
for learning introductory physics are even more impor- 
tant for learning quantum mechanics. 

We now have a suite of 18 simulations on various as- 
pects of quantum phenomena. These fall into three broad 
categories, illustrated in Table 1: fundamental princi- 
ples of quantum mechanics, key ideas in historical ex- 
periments, and quantum principles underlying everyday 
life applications. The PhET quantum simulations are 
available from http://www.phet.colorado.edu/quantum 
Each simulation has a web page that includes a brief 
description, learning goals, sample classroom activities, 
and "Tips for Teachers," which discuss approximations 
made in the simulation, common student difficulties, and 
suggestions for classroom use. 



Fundamental Principles 


Historical Experiments 


Applications 


Quantum Tunneling 
and Wave Packets 

Quantum Wave Interference 

Quantum Bound States 

Double Wells and 
Covalent Bonds 

Band Structure 

Fourier: Making Waves 


Photoelectric Effect 
Davisson Gernier: 

Electron Diffraction 
Stern-Gerlach Experiment 
Rutherford Scattering 
Models of the 

Hydrogen Atom 
Blackbody Spectrum 


Lasers 

Neon Lights &z 
Other Discharge 
Lamps 
Simplified MRI 
Conductivity 
Semiconductors 
Nuclear Physics 



TABLE L PhET simulations on quantum mechanics 



FIG. 1: Photoelectric Effect simulation. 

Simulations are powerful tools for helping students vi- 
sualize electrons, photons, atoms, wave interference, and 
other quantum phenomena that they cannot observe di- 
rectly. While students can conduct experiments on topics 
such as the photoelectric effect and double slit interfer- 
ence in many physics labs, there is much going on inside 
these experiments that they cannot observe. Photoelec- 
tric Effect (Fig. [J) allows students to watch electrons 
travel between the plates, helping them to build a model 
of why the current increases when you increase the in- 
tensity (they can see that more electrons leave the plate) 
but does not increase when you increase the voltage (they 
can see that the electrons travel faster between the plates 
but the number of electrons stays the same). Quantum 
Wave Interference (Fig. ^ allows students to follow a 
light wave from the source and through the slits, observ- 
ing it interfering with itself and collapsing into a dot on 
the screen. Models of the Hydrogen Atom (not shown) 
allows students to "see" inside atoms. 



B. Interactivity 

PhET simulations are highly interactive, directly cou- 
pling students' actions with the animation. Adjustment 
of controls results in an immediate animated response 
in the visual representations. Our research with student 
interviews shows that this interactivity helps students en- 
gage with the content and establish cause-and-effect rela- 
tionships. Further, interactivity that allows students to 
switch between representations enhances students' abili- 
ties to connect multiple representations!^ This interac- 
tion appears to be particularly effective for helping stu- 
dents construct understanding and intuition for abstract 
and unfamiliar quantum phenomena. For example, in 
Quantum Bound States (Fig. [9]), students can learn about 
the relationship between potential energy and wave func- 
tion by clicking and dragging directly on the potential 



3 




FIG. 3: Simplified MRI simulation. 

FIG. 2: Quantum Wave Interference simulation. 



energy diagram to change the offset, height, and width 
of potential wells, and immediately see the effect on the 
shape of the wave function. 



C. Context 

The focus on real-world contexts and applications that 
is a characteristic of nearly all PhET simulations is par- 
ticularly helpful in grounding quantum mechanics in stu- 
dents' everyday experiences. For example, Simplified 
MRI (Fig. [3]) enables students to learn about nuclear spin 
and energy splitting in the context of MRI. Neon Lights 
and other Discharge Lamps (not shown) enables students 
to see how neon lights work based on the concepts of 
atomic energy levels, energy transfer from electrons to 
atoms, photon emission, and atomic spectra. Putting 
basic concepts in these real-world contexts helps stu- 
dents appreciate the relevance of the physics, and work- 
ing through how MRIs and discharge lamps work also 
has the potential to help them understand the physics 
behind these applications. 



D. Taking advantage of the Computer 

Many of the quantum simulations take advantage of 
the power of computers to quickly do complex calcula- 
tions without exposing the user to the details. Thus, stu- 
dents can explore quantum tunneling and quantum wave 
interference qualitatively and focus on understanding the 
concepts without getting bogged down in the math. This 
has the potential to radically transform the way quan- 
tum mechanics is taught because it allows the instruc- 
tor to focus on the problems that are most important 
for students to understand rather than on the problems 
that are easiest to calculate. For example, while plane 



waves are certainly easier to calculate than wave pack- 
ets, we have found that plane waves are actually much 
more difficult conceptually for students to understandj^S 
Quantum Tunneling and Wave Packets (Fig.[4|) allows us 
to begin our instruction on tunneling with wave packets, 
so that students can visualize an electron as a slightly- 
but-not-completely delocalized object that approaches a 
barrier, interacts with it, and then partially reflects and 
partially transmits. This is not only much easier to vi- 
sualize and understand than a wave packet spread over 
infinite space interacting with a barrier for all time, but 
also more physically accurate. 
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FIG. 4: Quantum Tunneling and Wave Packets simulation. 

Simulations provide a unique tool for exploring time 
dependence in a way that is impossible in print media, 
helping students to see how quantum phenomena evolve 
and change in time. In Models of the Hydrogen Atom, 
Neon Lights and Other Discharge Lamps, and Lasers, 
students can observe atoms absorbing and emitting pho- 
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tons. In Quantum Tunneling and Wave Packets and 
Quantum Bound States, students can observe how wave 
functions change in time, exploring, for instance, the in- 
terchange between real and imaginary parts, the oscilla- 
tion of superposition states, and the collapse of the wave 
function when a position measurement is made. 



III. DEVELOPING RESEARCH-BASED SIMS 

Fig. El illustrates the design process for creating PhET 
simulations. The design cycle starts with content and 
student interface experts creating a detailed initial lay- 
out based on the learning goals of the simulation and the 
research base, including education and cognitive science 
research and the PhET design guidelines^. After cre- 
ating an initial version of the simulation that all team 
members feel is clear, accurate and engaging, we con- 
duct student interviews to determine whether students 
can understand how to use the simulation and achieve 
the learning goals. These interviews always reveal in- 
terface weaknesses, resolve interface questions that were 
not agreed upon by the team, and often reveal pedagogi- 
cally undesirable (and occasionally unexpected desirable) 
features and subtle programming bugs. Subsequent revi- 
sions are made, and if they are extensive, a further set of 
interviews are conducted. These interviews are not only 
used to improve the particular simulation but continue 
to improve our research base. After interviews estab- 
lish that the desired engagement and learning is being 
achieved, the simulation is used in a classroom setting 
where student use is observed and informally evaluated. 



Learning Goals] Deslgil PrOCeSS 



-Final Design 




FIG. 5: The PhET Design Process 



A. Building on Previous Research 

Research on how people learnt demonstrates that stu- 
dents learn by actively constructing their own under- 
standing, building on their prior knowledge. Further, 
experts and novices think about subjects differently. Ex- 
perts build an organized structure of knowledge that al- 



lows them to monitor and reflect on their own under- 
standing and focus on the underlying concepts. Novices 
often don't know what to focus on and get caught up in 
details that experts view as irrelevant. Because working 
memory is limited, education should focus on essential 
features to reduce cognitive load. 

PhET simulation design incorporates this research in 
many ways. Visualization and interactivity help students 
construct mental models. Putting physics in familiar 
real-world contexts helps students relate new concepts to 
prior knowledge. Simulations eliminate extraneous de- 
tails that are unavoidable when working with real equip- 
ment, such as the color of the wires or details of how the 
variable voltage supply works in the photoelectric effect 
experiment. 

We reduce cognitive load and help students construct 
their own understanding by starting simulations in simple 
states, allowing students to gradually work up to explor- 
ing more advanced features. For example, many simu- 
lations include several tabs (e.g. Figs. [2113]), where the 
first tab focuses on the basic ideas, and later tabs include 
more complex ideas. In Neon Lights and Other Discharge 
Lamps and Lasers, the first tab allows students to explore 
the behavior of a single atom before exploring a gas of 
many atoms. Fourier: Making Waves starts up with only 
a single non-zero Fourier component and an invitation to 
add more, so that students can build up complex patterns 
at their own pace rather than trying to make sense of a 
pre-existing pattern. These designs are based on both 
education research about how students learnt, and our 
own research showing that when we start simulations in 
more complex states, students become overwhelme d^^'^^ . 

Research on faculty adoption of research-based cur- 
riculum^ demonstrates that instructors rarely adopt a 
curriculum as is, but tend to adapt it to suit their lo- 
cal circumstances. At the same time, instructors need 
guidance on the essential features of a curriculum to 
help them adapt it effectively. To enable adaptation, 
we design the simulations to be open-ended and general- 
purpose, so that each can be used in many different ways 
to achieve many different learning goals. To assist in- 
structors in using the simulations effectively, we provide 
guidelines for developing guided inquiry activities^ and 
"Tips for Teachers" with guidance on the use of indi- 
vidual simulations. In addition, we provide a database of 
activities including lesson plans, lecture notes, and home- 
work.'*^ The database includes activities developed by the 
PhET team as well as those contributed by teachers. 

Simulation design is also based on research into stu- 
dent understanding of the specific content area of the 
simulation. There has been some previous research on 
student understanding of quantum mechanics, which we 
have incorporated into the design of the quantum sim- 
ulations. For example, research on student learning of 
the photoelectric effect shows that students often have 
difhculty interpreting the circuit diagram, drawing qual- 
itatively correct I-V graphs, distinguishing the effects of 
changing intensity and changing wavelength, and recog- 
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nizing that electrons are ejected by the hght rather than 
by the voltagei^i^ We designed the Photoelectric Effect 
simulation to address each of these difficulties. The cir- 
cuit is shown as a cartoon-like physical picture, rather 
than as an abstract diagram, and the variable voltage 
supply is illustrated as a battery with a slider. Students 
can interactively create I-V graphs. They can change the 
intensity, wavelength, and voltage, and immediately see 
the effects of each. In our modern physics class, we use in- 
teractive lecture demonstrations and homework designed 
to use these features of the simulation to address known 
student difficulties. This curriculum has been shown to 
be very effective at helping students understand the pho- 
toelectric effect.— 

Research on student learning about quantum tunnel- 
ing and wave functions shows that students often mix 
up wave function and energy^iSii^ One possible cause 
of this confusion is that instructors and textbooks often 
draw both on the same graph. In Quantum Tunneling 
and Wave Packets and Quantum Bound States, we show 
the two quantities on separate graphs. Quantum Bound 
States has also been designed to address research show- 
ing that students often have difficulty relating the shape 
of the wave function to the shape of the potential^ by al- 
lowing students to interactively explore the relationship 
between the two for a wide variety of potentials. 



B. Observations of Students 

In addition to addressing student difficulties seen in the 
literature, we often design simulations to address difficul- 
ties we see during observations of students when taking 
field notes in lecture and problem-solving sessions. 

While there are many existing simulations on double 
slit interference of electrons, none address what we ob- 
served to be the biggest problem for students in under- 
standing this phenomenon: visualizing the behavior of 
the electrons in between the slits and the screen. Stan- 
dard instruction often shows the pattern on the screen 
and assumes that students will know how to interpret 
this pattern, filling in the gap of the wave interference 
that must have created it. Our experience interacting 
with students in a variety of contexts indicates that stu- 
dents need help constructing a model of how the electrons 
create this pattern. Thus, in Quantum Wave Interfer- 
ence, we show an electron as a particle-like wave packet 
approaching the slits and interfering with itself before 
collapsing to a dot on the screen. 

When teaching the Davisson Germcr experiment, we 
observed in problem-solving sessions that many students 
did not understand the main point of the experiment 
after instruction. When instructors asked them to ex- 
plain the purpose of this experiment, students remem- 
bered that electrons were only detected at certain angles, 
but could not explain why. They viewed the electrons as 
particles that happened to bounce off at certain angles 
for some reason they could not understand, rather than 



recognizing how the observations could be explained by 
the wave nature of electrons. Although Quantum Wave 
Interference was not designed to address this difficulty, 
we found that it could be used to do so. In working with 
students one-on-one, we found that if we set up an ar- 
ray of barriers to represent atoms and demonstrated how 
electron wave packets aimed at this array reflected and 
interfered such that there were intensity maxima at cer- 
tain angles and minima at other angles, students immedi- 
ately responded with expressions like, "Oh, it's interfer- 
ing like a wave!" and were then able to correctly explain 
the purpose of the experiment. While this method was 
effective in helping students develop a correct explana- 
tion, the array of barriers was tedious to construct and 
difficult to change. Students often attempted to explore 
how changing the spacing and size of the barriers would 
change the pattern, but gave up quickly when they real- 
ized how hard it was to modify each barrier. To facilitate 
such exploration, we developed a new simulation, Davis- 
son Germer: Electron Diffraction, in which an array of 
atoms is set up automatically and the spacing and size 
can be changed by moving a slider. A classroom study 
demonstrating the effectiveness of this simulation will be 
presented in Section IVB. 



C. Student Interviews 

After developing an initial version of a PhET simula- 
tion, we test it in interviews in which students are di- 
rected to "think out loud" as they explore a simulation, 
either with no directions or with a simple guiding ques- 
tion. These interviews help us refine the user interface 
and pedagogical effectiveness of simulations. As we will 
discuss in Section |Vl interviews also provide new insights 
into student thinking and simulation effectiveness. In 
this section, we illustrate some examples of how we have 
used interviews to refine simulations. Unless otherwise 
noted, in all examples discussed in this article, students 
were engaged in undirected exploration of a simulation. 

Sometimes we come up with ideas that just don't work. 
In the initial version of Photoelectric Effect, we attempted 
to reduce students' cognitive load by starting with a 
"simple" model in which all electrons were ejected with 
the same energy. We thought that as students became 
more comfortable with this simple model, we would then 
introduce the "realistic" model, in which electrons were 
ejected with a range of energies. The simulation allowed 
students to switch between models with radio buttons 
labeled "simple" and "realistic." In interviews every stu- 
dent got caught up trying to figure out the difference be- 
tween these two modes, and either gave up or developed 
an incorrect explanation. Further, when we used the sim- 
ulation in class, many of the student questions during lec- 
tures and problem-solving sessions revolved around try- 
ing to understand the difference between the simple and 
realistic models. In response, we modified the simulation 
by replacing the "simple" and "realistic" radio buttons 
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with a checkbox labeled "show only highest energy elec- 
trons." It is unchecked by default, so that the simulation 
starts in the "realistic" model where electrons are ejected 
with a range of energies. When we used the new version 
in class the following semester, student questions focused 
much more on the physics behind the simulation. 

Interviews often reveal that seemingly small details can 
make a big difference in student understanding. For ex- 
ample, AA: and <Tk are two common labels for the width 
of a wave packet in Fourier space. Since most physicists 
are equally comfortable with both, the choice between 
the two seems irrelevant. However, in interviews on an 
early version of Fourier: Making Waves in which we used 
the label Ak, students referred to it as "the change in k." 
Because this incorrect interpretation of the label seemed 
so plausible, they were never able to determine what it 
actually meant. In interviews after we changed the la- 
bel to CTfc, students initially had no idea what the label 
meant. They were thus more willing to to explore it and 
were able to determine the correct meaning. 

Observations of what students attempt to do with sim- 
ulations often helps determine what additional features 
are needed. These features are often not obvious and 
could not have been foreseen by the developers. For ex- 
ample. Neon Lights and other Discharge Lamps includes 
an option for configurable atoms, in which students can 
modify the energy levels by clicking and dragging on 
them. In the initial version, students tried to drag the 
pictures of atoms labeling the energy levels rather than 
the levels themselves, and got frustrated when this didn't 
work. In response, we modified the simulation to allow 
students to click and drag the atoms as well as the levels. 

Unfortunately, interviews sometimes reveal problems 
that we do not know how to solve. We have found that 
students recognize when the scale is unrealistic and don't 
attempt to attribute meaning to the relative size of ob- 
jects such as for the macroscopic images of electrons, pho- 
tons, and atoms in Photoelectric Effect^ Neon Lights and 
other Discharge Lamps, and Lasers?^ However, we have 
not found any method that communicates clearly to stu- 
dents when the scale changes within a simulation. For 
example, in Quantum Wave Interference, students can 
choose to view interference of photons, electrons, neu- 
trons, or Helium atoms, all of which exhibit wave prop- 
erties at vastly different time and distance scales. We 
initially indicated the change in scale only by changing 
the units on the ruler and stopwatch, but students ei- 
ther did not notice or did not know how to interpret 
this change. We then tried adding a feature in which a 
clock with a note that says "slowing down time" and/or 
a magnifying glass with a note that says "zooming out" 
appears when the time/distance scale changes, but stu- 
dents did not know how to interpret this either. We left 
this feature in as a reminder, because while it didn't help 
students, it also didn't hurt. Students can still learn 
many other things from the simulation without recogniz- 
ing the change in scale, and if instructors want students 
to notice this change, they can point it out explicitly or 



incorporate this idea into homework activities. 

The issue of changing scale also caused problems in 
an early version of Models of the Hydrogen Atom, which 
allowed students to explore both atomic spectra and 
Rutherford scattering by shooting light and alpha par- 
ticles at an atom. However, because light interacts with 
the electrons and alpha particles interact with the nu- 
cleus, these two processes occur at very different scales. 
Initially we tried to gloss over this fact by showing both 
at an intermediate scale. This led to a great deal of 
confusion in interviews. Students thought the alpha par- 
ticles were interacting with the electrons and often drew 
incorrect conclusions, such as that alpha particles are 
negatively charged. After these interviews we decided 
that we were trying to show too many different things in 
a single simulation, and split the alpha particle feature 
into a separate simulation called Rutherford Scattering. 



IV. CLASSROOM USE AND TESTING 
A. Examples of Classroom Use 

Most of the quantum simulations were developed for 
use in a reformed large-lecture modern physics course for 
engineering majors This course used the simulations 
in a variety of contexts including: general visual aids; in- 
teractive lecture demonstrations, where we demonstrated 
key phenomena and asked students to make predictions 
about the behavior of simulations using clickers; and 
homework, which guided students through exploration 
of simulations. Our course material is available from the 
PhET activities database^ (search for author "McKa- 
gan") or from our modern physics course archive^. 

An example of a visual aid is our use of Quantum Wave 
Interference in lecture to demonstrate how the double slit 
experiment shows that light must be both a wave that 
goes through both slits and a particle that hits the screen 
at a single location.^" This lecture led to an unexpected 
onslaught of deep, fundamental questions that took up 
nearly an entire class period. Student questions included: 

• How can it be such a huge blob and then be de- 
tected in one place? 

• Is it that we just don't know where it is or is it 
really spread out in space? 

• What does it take for a photon to collapse to a 
single point? How does that happen? 

• In real life can you really turn it down so low that 
you only have one photon coming out at a time? 

• How big is a photon? Can it be a meter wide? 

These questions are similar to those asked by the 
founders of quantum mechanics as they worked out the 
meaning of this new theory. Student difhculties often do 
not reflect the historical questions of scientists because 
students struggle with much more basic questions. In 
this case, we argue that the visualization provided by the 
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simulation allowed students to see the heart of the issue 
and ask deep questions earlier in the learning process. 

Fig. [6] illustrates the use of a simulation for an interac- 
tive lecture demonstration. This is a typical question in 
which students discuss with their neighbors and then se- 
lect an answer using clickers. After asking a few students 
to give explanations for their answers to the whole class, 
we use Quantum Tunneling and Wave Packets (Fig. 3]) 
to demonstrate what actually happens. Students always 
point out that the simulation in fact shows the wave be- 
ing partially reflected and partially transmitted, rather 
than reflected OR transmitted, as in the correct answer 
D. After a class discussion of this discrepancy, we use the 
"Make Quantum Measurement" button in the simulation 
to demonstrate that after it is measured, the electron is 
always reflected or transmitted, never both. 



FIG. 6: Sample interactive lecture demo question with Quan- 
tum Tunneling and Wave Packets. The correct answer is D. 

Another way to use simulations is in homework. In 
our modern physics class, students work through a series 
of questions using Lasers to build up an understanding 
of how a laser works. '^^ The homework starts with basic 
questions about absorption and spontaneous and stim- 
ulated emission, works through the steps of building a 
laser and troubleshooting a broken laser, and ends with 
essays on why a population inversion is necessary to build 
a laser and why this requires atoms with three energy lev- 
els instead of two. Most students are able to give correct 
and thorough explanations in these essays. 

B. Classroom testing of simulation effectiveness 

We have conducted several studies in our reformed 
modern physics course to test the effectiveness of sim- 
ulations and other aspects of the course. 

The most extensive testing of classroom use of a spe- 
cific quantum simulation has involved Photoelectric Ef- 
fect. In a recent study we showed that with our curricu- 
lum that included both interactive lectures and home- 



work using the simulation, learning much greater than 
with either traditional or previous reformed instruc- 
tion."*^ For example, on an exam question about whether 
increasing the voltage between the plates would lead to 
electrons being ejected when the light frequency was too 
low, an average of 83% of students answered correctly 
with correct reasoning in the courses using the simula- 
tion, compared to 20% of students in a traditional course 
and 40% of students in a traditional course supplemented 
by a research-based computer tutorial. 

In the course as a whole, where simulations were used 
extensively in all the ways discussed in Section IVA, we 
found high learning gains (measured by the Quantum 
Mechanics Conceptual Survey^) and a lack of shift in 
beliefs about physics (measured by the Colorado Learn- 
ing Attitudes about Science Survey"*-). In contrast, in the 
course for engineering majors the semester before our re- 
forms and in the corresponding course for physics majors, 
there were low learning gains and large negative shift in 
beliefs.*^ While we made many reforms in this course, 
the simulations played a large role in all of them, and 
likely contributed to the improved learning and beliefs. 

Student perceptions provide a further indicator of sim- 
ulation effectiveness. On the end-of-term survey for our 
modern physics course {N = 173), the average student 
ranking of the usefulness of the simulations for their 
learning on a scale of 1 (not useful) to 5 (a great deal) 
was 4.0, close to the highest ranked aspect of the course. 
The usefulness rankings for other aspects of the course 
ranged from 3.2 (the textbook) to 4.3 (the posted lec- 
ture notes). Students also had the opportunity to make 
comments about the simulations in the survey, and 35% 
(iV = 61) chose to do so. Of these comments, 80% were 
positive comments about the usefulness of the simula- 
tions, for example: 

• Great sims, I can't imagine QM without them. 

• The simulations were crucial in the learning pro- 
cess. 

• The simulations were the best part of class, they 
practically answer physics questions all by them- 
selves. I would recommend continuing to develop 
these and add more. Without these I think I would 
have been lost in the course. 

• I definitely not only enjoyed the simulations, but 
I'd go as far to say that the simulations taught me 
the most about the course because I could really 
visualize the inner workings of the physics processes 
that were going on. 

• I thought the simulations were great. It helped 
me to gain intuition about the topic. This is espe- 
cially useful in quantum mechanics where it is not 
normally possible to directly observe the described 
phenomena. 

Other types of comments about the simulations included 
pointing out: that the simulations need guidance to be 
useful (13%); that the simulations were incorrect or not 
useful (8%); specific technical problems (7%) (most of 



An electron is traveling through a very long wire, 
approaching the end of the wire: 






E 


V{x)=0 




V(x)=Vo 



If the total energy E of the electron is GREATER than the 
work function of the metal, Vo, when the electron reaches 
the end of the wire, it will... 

A. stop. 

B. be reflected back. 

C. exit the wire and keep moving to the right. 

D. either be reflected or transmitted with some probability. 

E. dance around and sing, "I love quantum mechanics!" 
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these have since been resolved) ; and that the simulations 
are not experiments (3%)j^ 

We also conducted qualitative observations of stu- 
dents in this course by taking field notes in lecture and 
problem-solving sessions and conducting regular inter- 
views with six students. In all these observations, we 
consistently saw that for topics where we used simula- 
tions, students developed extremely vivid mental models. 
For example, when we asked students in problem-solving 
sessions and interviews about topics related to simula- 
tions, they gave animated responses easily and without 
much time for thought. On exam questions on topics such 
as the photoelectric effect, discharge lamps, and lasers, 
students gave vivid, detailed responses, often referring 
to the simulations explicitly and correctly remembering 
minute details. On the other hand, when we asked stu- 
dents about other topics not related to simulations, such 
as models of the atom or infinite square wells (before we 
developed simulations on these topics), students had to 
think for a long time, attempting to retrieve memorized 
facts, and often mixed up important details. 

In another classroom study, we set out to determine the 
prevalence of student difficulties with the Davisson Ger- 
mer experiment discussed in Section IIIB, and to evaluate 
the effectiveness of the simulation in addressing these dif- 
ficulties. This study was conducted in a modern physics 
course for physics majors that used much of the same 
curriculum as the course for engineering majors discussed 
elsewhere in the paper, but had a very different popula- 
tion of students. In general, the physics majors seemed 
to pick things up more quickly and had fewer of the dif- 
ficulties observed among the engineering majors. 

(a) All students (N=59) (b) Students who read (N=38) 



other 




waves, 

inter- ^^j^/^ 
ference 



non-wave 
explanation 



waves, no explanation 




■ electrons are waves, explain with interference: 

e.g.; 'The electrons were only detected at certain angles because 
they were interfering constructively and destructively. It was 
important because it meant they were acting like waves.' 

■ electrons are waves, no explanation: 

e.g.; 'The reason for this result of seeing electrons only at certain 
angles is matter waves. The electrons are traveling with a certain 
wavelength, making it so they can only be deflected at certain angles.' 

□ non-wave explanation: 

e.g.; 'Shooting electrons at a neatly arranged lattice, the electrons 
that bounce off will have a higher probability of hitting another 
atom. Since all the atoms in the lattice are neatly arranged, they 
will create a series of pathways that the electrons will bounce 
down. Therefore, the angles they observed were the angles at 
which the electrons bounced down these "tubes".' 

□ blank / no explanation: 

e.g.; 'You got me. I didn't read.' 



FIG. 7: Student responses to reading quiz on Davisson Ger- 
mer experiment. 



In the class before students were expected to read the 
relevant section of the textbook (Knight 24.4^^), they 
were told that there would be a reading quiz on the Davis- 
son Germer experiment in the next class. This reading 
quiz was emphasized much more than usual, to ensure 
that students would do the reading. In the quiz, students 
were asked to answer to the following question: "In the 
Davisson Germerexperiment, Davisson and Germer shot 
a beam of electrons at a lattice of Nickel atoms and found 
that the electrons were only detected at certain angles. 
Explain the reason for this result and why it was impor- 
tant." The correct answer, that the observed pattern was 
characteristic of an interference pattern and therefore it 
showed that electrons behave as waves, is illustrated by 
the first sample student response in Fig. [71 As shown in 
Fig. [7^, only about a third of students gave this type of 
answer. Another third said that electrons are waves but 
did not explain this result in terms of interference, as in 
the second sample response. Most of the remaining third 
gave an incorrect explanation that did not involve wave 
behavior at all, as in the third sample response. 



Since it is possible that these poor results were the re- 
sult of students not doing the reading, a clicker question 
in the next class asked students whether they did the 
reading on the Davisson Germer experiment. Students 
were promised that their instructor would not look at 
their individual responses, and 35% admitted to not do- 
ing the reading or not remembering whether they did or 
not. Fig. [7)3 shows the responses to the reading quiz for 
the students who said they did the reading. (Students 
who may have done the reading but were not present for 
the clicker question are not included in Fig. [7)3.) When 
counting only students who did the reading, the percent- 
age of students who answered the reading quiz question 
correctly goes up to nearly half. However, the remaining 
half either did not explain how the experiment leads to a 
wave model, suggesting that they had simply memorized 
the answer without understanding it, or gave explana- 
tions of the experiment that did not involve waves at all. 



The reading quiz was followed by an interactive lecture 
on the Davisson Germer experiment, in which the Davis- 
son Germer: Electron Diffraction simulation was used in 
one of the two sections, and a homework in which stu- 
dents in both sections were asked to use the simulation to 
explain the Davisson Germer experiment and its appli- 
cation to understanding the structure of crystalsi^ On 
a midterm exam, students were again asked to explain 
the inferences that could be drawn from this experiment, 
but were not told what was seen in the experiment. On 
the exam question, 92% of students correctly explained 
that there was an interference pattern that illustrated 
the wave nature of electrons. These exam results indi- 
cate that the simulation, along with the accompanying 
lecture and homework, was extremely effective in helping 
students understand the Davisson Germer experiment. 
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V. LEARNING FROM STUDENT INTERVIEWS 

The primary purpose of the think-aloud interviews 
that we conduct as part of our simulation design pro- 
cess is to find problems with the simulations in order to 
improve them. However, interviews are also valuable for 
demonstrating the effectiveness of simulations and giv- 
ing general insights into student thinking. In this section 
we present some examples of what we have learned from 
interviews on quantum simulations. 

Interviews help us determine what students can and 
cannot learn from each simulation. (Details of these in- 
sights are provided in the "Tips for Teachers" available 
from the web page for each simulation.) We have found 
that students can usually learn some important concepts 
from undirected exploration of simulations, but they can 
learn much more from using the simulations in conjunc- 
tion with activities that guide their exploration. With 
undirected exploration, students can often give correct 
explanations of many of the concepts that the simulation 
is designed to teach, but do not necessarily recognize that 
they have learned, often because they do not understand 
the significance or application of the content. 

For example, students with no previous instruction on 
Fourier analysis who explored Fourier: Making Waves 
in interviews were able to give correct descriptions of 
Fourier analysis and explain everything in the first tab, 
but claimed that they did not understand the point of 
the simulation. Students with no background in mod- 
ern physics who explored Photoelectric Effect were able 
to correctly explain how the experiment worked and the 
results, but did not make connections to the greater im- 
plications for the nature of light. 

The simulations can be greatly enhanced by a good 
activity (e.g. homework, lab, or interactive lecture) that 
guides students' exploration towards the learning goals 
of the instructor and helps place the concepts within a 
larger context. Many activities are available for the quan- 
tum simulations on the PhET website'*'^, some developed 
by PhET team members as part of our modern physics 
course transformation, and some contributed by users. 
While we have not done studies that directly compare 
undirected and guided exploration of the simulations, we 
have measured learning gains from using guided activi- 
ties in the studies discussed in the previous section, and 
we have seen improved student learning as a result of 
guidance in interviews. 

For example, in interviews on Quantum Tunneling and 
Wave Packets, most students were able to explain the be- 
havior of the simulation after they hit the 'Make Quan- 
tum Measurement" button in "wave packet" mode, but 
needed help from the interviewer to explain the behav- 
ior in "plane wave" mode (see Fig. [5]). In "wave packet" 
mode, this button causes the probability density to col- 
lapse to a narrow packet whose position is determined 
randomly according to the probability density immedi- 
ately before measurement. In "plane wave" mode, this 
button causes the probability density to go to zero ev- 
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FIG. 8: The "Make Quantum Measurement" button in Quan- 
tum Tunneling and Wave Packets measures the position of the 
electron in the probability density vs. position graph in (a) 
"wave packet" mode and (b) "plane wave" mode. 



erywhere. Out of six students interviewed on this simu- 
lation, three were able to explain the behavior in "wave 
packet" mode without help, two were able to explain it af- 
ter a hint from the interviewer, and one never made sense 
out of it. Three students who had successfully explained 
the behavior in "wave packet" mode then tried the but- 
ton in "plane wave" mode. All three expressed confusion 
over what they saw and none were able to explain it on 
their own. The interviewer then asked, "How far does a 
plane wave extend in space?" All three students quickly 
answered that it extends over infinity, and therefore the 
probability of measuring it in the region shown on the 
screen is zero. The results of these interviews suggest 
that a guided activity including the question asked by 
the interviewer could help students learn the effects of 
measurement on plane waves much more effectively than 
unguided exploration. 

An interview on Quantum Bound States provides an 
example of a student learning an advanced topic from 
undirected exploration of a simulation. This simulation 
contains two advanced tabs that allow students to ex- 
plore double and multiple wells (Fig. (These tabs 
are also available separately as the simulations Double 
Wells and Covalent Bonds and Band Structure.) In most 
of our interviews with Quantum Bound States, the stu- 
dents spent so long playing with single wells that they 
never got to the advanced tabs, so we have only con- 
ducted one interview in which the student spent more 
than a few minutes playing with two wells. This student, 
who had previous instruction on single wells but not dou- 
ble wells, was able to explain, based on his exploration 
of the simulation, the reason for the pairs of symmetric 
and anti-symmetric states for double wells: "...because 
we have two wells here, so... I want to think that one 
is more centered around this one and the other is more 
around this one, and I guess we don't know which one 
is which, which is why they're both symmetrical around 
these." He was troubled, however, that he was unable 
to determine the physical interpretation of the difference 
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FIG. 9: The "Two Wells" tab of Quantum Bound States (also 
Double Wells and Covalent Bonds), showing the symmetric 
(tpi) and anti-symmetric {tp2) states. The "Many Wells" tab 
(also Band Structure), not shown, allows users to create an 
array of up to 10 wells. 



between these two states. While it is possible that this 
interview result was idiosyncratic, it is a valuable exis- 
tence proof that it is possible for a student to learn a very 
advanced concept from undirected exploration of the sim- 
ulation. If one student can learn so much with so little 
guidance, it is likely that many students can learn this 
concept with a guided activity. 

Interviews also help us determine the range of levels 
of students for which simulations are appropriate. There 
are a few simulations, such as Quantum Tunneling and 
Wave Packets, Quantum Bound States, Double Wells and 
Covalent Bonds, Band Structure, and Davisson Germer: 
Electron Diffraction, that require a basic knowledge of 
the phenomena being illustrated and therefore do not 
appear to be effective for students who have not had 
any instruction on the relevant topics. Other simulations 
that one might imagine are too advanced have proven 
to be surprisingly effective for a wide range of students. 
For example, several simulations have been used success- 
fully in lecture demos and homework in courses for non- 
science majors, including Nuclear Physics, Conductivity, 
and Semiconductors in "The Physics of Everyday Life," 
and Fourier: Making Waves in "Sound and Music." In 
interviews, after a half hour of unguided exploration, 
students with no science background have been able to 
give good qualitative explanations of the physics behind 
simulations such as Quantum Wave Interference, Lasers, 
Neon Lights and Other Discharge Lamps, Photoelectric 
Effect, Nuclear Physics, and Semiconductors. Finally, a 
PhET team member's 9-year-old son enjoys playing with 
Lasers and Models of the Hydrogen Atom, and has figured 
out much of the basic physics behind these simulations. 
For example, he can explain how the photons change the 



energy levels and how to change the separation of energy 
levels to match energy of light to get lasing in Lasers. 

In interviews with students who have had previous in- 
struction on the topics covered by the simulations, we 
find that the visual representations can help students ad- 
dress incorrect models that would otherwise be difficult 
for an instructor to detect. For example, one student, 
upon seeing the wave packet representing a photon in 
Quantum Wave Interference, said, "Until now, I thought 
that, if I were to represent one particle, it would just be 
one thin line going up. I did not know that it would be 
like, all over here." When the interviewer asked why he 
thought it would be one thin line, he described his in- 
structor drawing a series of thin lines [wave fronts] and 
referring to a line as "this one wave." Another student 
initially predicted that if you moved the slits further from 
the screen the separation between the interference fringes 
would decrease, and was able to use the simulation to cor- 
rect his prediction and develop an explanation for why 
the separation actually increases. 

Interviews on Models of the Hydrogen Atom provide 
a further example of a simulation uncovering an incor- 
rect model developed from previous instruction. In these 
interviews, some students described the Plum Pudding 
model as a cloud of negative charge filled with little 
specks of positive charge, rather than the other way 
around. The use of the word "cloud" suggests that these 
students are mixing up the Plum Pudding model with 
the Schrodinger model, in which the electrons are often 
described as a cloud of negative charge. These students 
initially thought that the electron in the simulation was 
a proton, but were eventually able to identify it correctly 
by using the legend or by comparing it to the electrons 
in other models. 

The development of Quantum Wave Interference, 
Quantum Tunneling and Wave Packets, and Quantum 
Bound States illustrates what we have learned about 
what representations of wave functions are most con- 
ducive to student learning. Our team put a lot of thought 
into how to represent quantum wave functions (Fig. llOp 
in these simulations. Most textbooks only show plots 
of the real part of the wave function, but also discuss 
the imaginary part of the wave function. The magnitude 
and phase may be discussed in a junior level quantum me- 
chanics course, but usually not in a sophomore level mod- 
ern physics course. Most non-PhET simulations of wave 
functions use a "phase color" representation in which a 
curve representing the magnitude of the wave function is 
filled in with colors representing the phase (Fig. [TOb). 

In observations and interviews in many contexts, we 
noticed that students often asked about the meaning of 
the imaginary part of the wave function, but never about 
the real part. Further, students often forgot about the 
imaginary part entirely, or said that you only need to 
consider the real part when squaring the wave function. 
We hypothesize that students overestimate the impor- 
tance of the real part and underestimate the importance 
of the imaginary part for two reasons. First, the unfor- 
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FIG. 10: Representations of the wave function in Quantum 
Tunneling and Wave Packets: (a) real and imaginary parts 
and (b) magnitude and phase. In interviews students can 
make sense of (a) but struggle with (b). 

tunate choice of words "real" and "imaginary" naturally 
leads to the idea that one is more "real" than the other 
in the common English sense of the word, when in fact 
both components are on equal footing mathematically. 
Second, the fact that many textbooks illustrate only the 
real part (but label it as V') niay encourage students to 
focus only on this part of the wave function. 

To address this problem, we illustrate both the real 
and imaginary parts on equal footing in the simulations 
(Fig. \Wk). We suspected that the real and imaginary 
parts of the wave function would be easier for students 
to understand than the magnitude and phase, because 
these representations relate more easily to what students 
typically calculate and to familiar sine and cosine waves. 
However, we also included options to show the magnitude 
and phase color for completeness. 

In interviews on Quantum Wave Interference, one stu- 
dent commented that he did not understand real and 
imaginary numbers, and one student who wondered why 
the imaginary part didn't look different from the real 
part until he paused the simulation and could see that 
they were out of phase. Aside these two students, whose 
confusion stemmed more from their expectations than 
from the simulation, students did not express any confu- 
sion over the real and imaginary representations of the 
wave function in interviews on Quantum Tunneling and 
Wave Packets and Quantum Wave Interference. Sev- 
eral students also learned important concepts by playing 
with the real and imaginary views. For example, students 
learned from the simulation that the real and imaginary 
parts were 90 degrees out of phase, and that the real and 
imaginary parts add up to a constant probability den- 
sity in an energy eigenstate even though each individual 
component changes in time. 

On the other hand, the "phase color" representation 
caused significant problems for most students. In in- 
terviews on Quantum Wave Interference, three out of 
five students interviewed explored this view. None of the 
three made any comments on it on their own, aside from 
one student who said it hurt his eyes, so the interviewer 



asked them what it was showing. One student said it 
was "some sort of frequency type of thing" and specu- 
lated that teal would constructively interfere with teal 
and destructively interfere with the opposite of teal. An- 
other stared at the screen in confusion for a minute, and 
then described it as "some sort of representation of both 
the real part and the imaginary part" showing that "pink 
is areas of high real part and low imaginary part or some- 
thing?" Another student was unable to give any expla- 
nation. When the same three students were interviewed 
later on Quantum Tunneling and Wave Packets, the two 
who had given explanations in earlier interviews did not 
comment on phase view again. The student who had 
been unable to give any explanation remembered that 
this view had been used in his quantum course, but still 
could not explain what it meant. Of three additional stu- 
dents who were interviewed on Quantum Tunneling and 
Wave Packets but not Quantum Wave Interference, two 
expressed frustration over the phase view and were un- 
able to explain it, and the third, when asked to explain it, 
said only that it showed "something about wavelength." 
When given a choice, none of the students spent much 
time in phase mode, returning quickly to real or magni- 
tude mode after answering the interviewer's questions. 

"Phase color" is still an option in the simulations for 
instructors who would like to explicitly teach the use of 
this representation or use activities developed for other 
simulations, but we recommend caution in its use. 



VI. CONCLUSION 

In summary, PhET quantum simulations are designed 
to address previously-known student difficulties in quan- 
tum mechanics, as well as many new student difficulties 
uncovered as a result of our research. The key features of 
PhET simulations - visualization, interactivity, context, 
and effective use of computations - are particularly ef- 
fective for helping students understand the abstract and 
counterintuitive concepts of quantum mechanics. Our 
research has shown these simulations to be effective in 
helping students learn, and has revealed new insights into 
how students think about quantum mechanics. 
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